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We analyze the decay 5° K%ir^-K~ using a sample of 232 million T(4S) BB decays collected 
with the BABAR detector at the SLAC PEP-II asymmetric-energy B factory. A maximum likelihood 
fit finds the following branching fractions: B{B° K°Tv+n-) = (43.0 ± 2.3 ± 2.3) x 10"^ B{B° 
fo{^ 7v+Tv-)K°) = (5.5 ± 0.7 ± 0.5 ± 0.3) x lO-** and B{B° K'+n-) = (11.0 ± 1.5 ± 0.5 ± 
0.5) X 10^". For these results, the first uncertainty is statistical, the second is systematic, and the 
third (if present) is due to the effect of interference from other resonances. We also measure the 
CP-violating charge asymmetry in the decay B^ — > K*'^tv~ , Ak^-k = —0.11 ± 0.14 ± 0.05. 

PACS numbers: 13.25.Hw, 12.15.Hh, ll.30.Er 



Measurements of charmless three-body B decays, 
which are dominated by their intermediate quasi-two 
body decays, are important in furthering our under- 
standing of quark couplings described by the Cabibbo- 
Kobayashi-Maskawa matrix fH. CP violation can be 
probed through the investigation of neutral _B-meson de- 
cays to resonance channels with the final state K^n^n^ , 
such as /nif" 0, p^if" and K*+tt- Q. 

By measuring the charmless branching fraction of 
i^sTT+Tr", along with those of its dominant 
resonant sub-modes, we can obtain information about 
the structure of the decay Dalitz plot. Such measure- 
ments have previously been performed by the CLEO , 
Belle P and BABAR%^^ experiments. 

QCD factorization models 7] have predicted branch- 
ing fractions and asymmetries for charmless B decays. 
Predictions have also been made using flavor SU(3) sym- 
metry 8]. For 5° K*'^Tr~ , predictions 9] have been 
made for the branching fractions and charge asymmetry, 

^K'-K - — -p , (1) 

which is a CP-violating quantity since the decay channel 
is a flavor eigenstate. CP violation in charge asymmetry 
has already been observed by BABAR and Belle in B'^ 

K+TT- [13. 

In this paper the branching fractions of B''^ 
K°TT+Tr-, B° K*+TT- and B° /o(980)(-^ '!t+tt-)K° 
are presented, averaged over charge-conjugate states, 
along with a measurement of the charge asymmetry in 5° 
—f K*~^TT~ . The selection criteria require events with a 
reconstructed if!? in the final state. Results are stated in 
terms of the if ° final state, taking into account the prob- 
abilities for B{K" -> K",) and B{K"^ -> tt+tt") [l^. For 
the B^ K'^tt^tt^ branching fraction, the total charm- 
less contribution to the Dalitz plot is measured (with 
charmed and charmonium resonances removed), includ- 
ing contributions from resonant charmless sub-structure. 

The data used in this analysis were collected at the 
PEP-II asymmetric-energy e+e^ storage ring with the 



BABAR detector [T3|. The BABAR detector consists 
of a double-sided five-layer silicon tracker, a 40-layer 
drift chamber, a Cherenkov detector, an electromagnetic 
calorimeter and a magnet with instrumented flux return. 
The data sample has an integrated luminosity of 210 fb~^ 
collected at the T(4S) resonance, which corresponds to 
(231.8±2.5) X 10^ BB pairs. It is assumed that the T(4S) 
decays equally to neutral and charged _B-meson pairs. In 
addition, 21.6 fb~^ of data collected at 40 MeV below 
the T(4S) resonance were used for background studies. 

The reconstruction of candidate B mesons combines 
two charged tracks and a K'^ candidate, with the 
being reconstructed from two oppositely charged tracks 
consistent with tt+tt^. The decay vertex is recon- 
structed from the two charged tracks that were not 
daughters of the K'^, with the requirements that the 
tracks originate from the beam-spot, have at least 12 hits 
in the drift chamber and have a transverse momentum 
greater than 100 MeV/c. candidates are required to 
have a reconstructed mass within 15MeV/c^ of the nom- 
inal mass ^3 1 ^■t least a five standard deviation sep- 
aration between the B'^ decay vertex and its own decay 
vertex, and a cosine of the angle between the line joining 
the B" and if^ decay vertices and the K'^ momentum 
vector greater than 0.999. To identify pions we use mea- 
surements of energy loss (dE/dx) in the tracking system, 
the number of photons detected by the Cherenkov detec- 
tor and the corresponding Cherenkov angle. Candidate 
pions must fail the electron selection, which is based on 
dE/dx measurements, shower shape in the calorimeter, 
and the ratio of energy in the calorimeter to momen- 
tum in the drift chamber. Using simulated Monte Carlo 
(MC) events, we determine an approximate mean and 
width (cr) of the mass distribution for the resonances, 
and choose the resonance band to be ±3(j from the mean. 
For the decay B° K*~^7r~ we require 0.776 < m^o^ 
< 1.010 GeV/c2 and for B° foK^ we require 0.879 < 
m^+„- < 1.069 GeV/c2. 

The dominant source of background is continuum 
quark production (e^e^ — > qq where q = u,d,s,c). An 
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event-shape variable, the cosine of the angle 9t between 
the thrust axis of the selected B candidate and the thrust 
axis of the rest of the event 0, is used to suppress 
this background. The distribution of | cos 0^1 is strongly 
peaked towards unity for continuum background but is 
flat for signal events. The requirement |cos0t| < 0.9 
reduces the relative amount of continuum background. 

To separate signal events from the remaining back- 
ground events, we use two kinematic variables and one 
event-shape variable. The first kinematic variable A£^, is 
the difference between the center-of-mass (CM) energy of 
the B candidate and -s/s/Z, where y/s is the total CM en- 
ergy of the e+e~ beams. The second is the beam-energy- 
substituted mass mEs = \/ (s/2 + Pj • PB)^/Ef — p^, 
where ps is the B momentum and {Ei,pi) is the four- 
momentum of the T(4S) in the laboratory frame. We re- 
quire these variables to be in the ranges \AE\ < 0.1 GeV 
and 5.22 < toes < 5.29GeV/c^. We construct a Fisher 
discriminant {J^) |l3| using a linear combination of five 
event-shape variables: the cosine of the angle between the 
-B-candidate momentum and the beam axis, the cosine of 
the angle between the B-candidate thrust axis and the 
beam axis, the zeroth and second angular moments of the 
energy flow about the thrust axis of the B 0, and the 
output of the i?-flavor tagging algorithm, which uses the 
information from the other B jlj]. This forms a more 
efficient Fisher discriminant than used in our previous 
measurement, Ref. 3- 

Other i?-meson decays can mimic a ifgTr+Tr" final 
state. MC events are used to identify the B decays 
that contribute background events to the data sample, 
and we use the available information on exclusive mea- 
surements 0, to find how many events from this 
background to expect in the data set. The largest B 
background is seen to come from quasi two-body decays 
including charmonium mesons such as J/tpK'^, XcqKs 
and 'il;{2S)K'^. In these cases the charmonium meson 
decays to tt+tt^ or to fJ.'^fJ.~ that are misidentified as 
pions. Most of these events are removed by vetoing 
the reconstructed tt+tt" masses consistent with 3.04 < 
TO^+^- < 3.16 GeV/c2, 3.32 < m^+^- < 3.51 GeV/c^ 
and 3.63 < m^+^- < 3.74 GeV/c^, identifying the J/i/", 
Xco and ipi'2S) mesons respectively. From simulated data 
we estimate that 126 ± 8 ^ J/tpKg events and 6 
±35°^ tp{2S)K'^ events fall outside these vetoes, 
and these are included in the model. We veto events 
that are consistent with 5° D^{-^ K^'k~)tt^ by ex- 
cluding those with 1.8 < rrij^o^ < 1.91 GeV/c^. How- 
ever, Monte Carlo simulation shows that 71 ± 8 i3° ^ 
D~{-^ K'^Tr~)TT^ background events still remain, where 
the reconstructed mass falls outside the veto as a re- 
sult of using a if g or a tt from the other B decay in the 
event. Other incorrectly reconstructed charmed decays 
are also included in the model. 

After the above selection criteria are applied, 12.4% of 
events have more than one candidate that satisfies the 



selection criteria. In a signal MC study, selecting the 
candidate whose cos 6t value is closest to zero is found to 
select the true signal candidate in 69.2% of such events. 
These requirements result in a final sample size of ap- 
proximately 80,000 events. 

After all requirements, the largest charmless B back- 
ground to the i?° if^TT+TT^ measurement is the decay 
B° v'K°,r]' p0(770)7,p° tt+tt", which tends to 
peak in the signal region and which contributes 54 ± 19 
events. Table 13 shows the B-background modes for the 
BO K*^TT^ and foK° channels. These events 

are effectively subtracted from the measured signal. To 
measure the nonresonant — s- if ^ tt+tt", we select a re- 
gion of the Dalitz plot believed to be free of resonances, 
(3 < m^+^- < AGeV/c^ and to^o^± > 1.91 GeV/ c^). 
Backgrounds from other B decays and from continuum 
events are subtracted. Assuming a uniform nonresonant 
distribution in the Dalitz plane, we set an upper limit of 
2.1 xlO~^ at a 90% confidence level on the nonresonant 
B'^ — > ifgTT+TT" branching fraction. All other branching 
fractions are taken from Refs. 0, E| . 

TABLE I: The -B-background modes for the channels B° — > 
if *±7rT and B° foK^. B° p°K°s is included at a level 
consistent with Ref. Q. K** refers to heavier K* resonances, 
e.g. ifo*(1430). 



i3-background 


Number Expected Number Expected 


Mode 




(SO ^ ^0^0) 






5 ± 1 


i?" - /oifg 


4 ± 1 




B° ^ p°if° 


5 ± 2 


14 ± 4 


B° K**+Tv- 


23 ± 3 


4 ± 1 


Nonresonant 


7 ± 1 


5 ± 1 


B° DT7r± 


16 ± 2 





B« v'K°s 


1 ± 1 


19 ± 7 


B'^^J/^Kl 


6 ± 1 






We use an extended maximum likelihood fit to extract 
the signal yield for each of the channels being investi- 
gated. The likelihood function for N events is: 

N / M \ 
£ = exp(-^7V,)I] \ Y.N,P,{x{)\ (2) 

where i and j are integers, M is the number of hypothe- 
ses (signal, continuum background and B background), 
Nj is the number of events for the jih hypothesis deter- 
mined by maximizing the likelihood function, and Pj{xi) 
is a probability density function (PDF) evaluated using 
the vector Xi, in this case toes, Ai<^, and T . Correlations 
between these variables are small for signal and contin- 
uum background hypotheses and the total PDF is a prod- 
uct Pj{xi) = Pj(toes) • Pji^E) ■ Pj{J^). However for B 
background, it is necessary to account for correlations ob- 
served between toes and IS.E by using a two-dimensional 
PDF for these variables. 
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The parameters of the signal and i3-background PDFs 
are determined from MC simulation and fixed in the fit, 
along with the i3-background normalization. The con- 
tinuum background parameters are allowed to vary in 
the fit, to help reduce systematic effects from this domi- 
nant event type. Sideband data (which lie in the region 
0.1 < A£; < 0.3 GeV and 5.22 < toes < 5.29GeV/c2) 
are used to model the continuum background PDFs. For 
the Toes PDFs, a Gaussian distribution is used for sig- 
nal and a threshold function 16] for continuum. For the 
AE PDFs, a sum of two Gaussian distributions with the 
same means is used for the signal and a first-order poly- 
nomial for the continuum background. Finally, for the J- 
PDFs, a sum of two Gaussian distributions with distinct 
means and widths is used for signal and a sum of two 
Gaussian distributions with the same means is used to 
model the continuum background. The Fisher discrim- 
inant distribution of the B backgrounds is modeled by 
an asymmetric Gaussian distribution that has different 
widths above and below the modal value. We use B'^ 

calibration mode since it exhibits 
a one-to-one signal to continuum background ratio, al- 
lowing the signal parameters in a fit to be floated. A 
fit to these data is used in order to quantify any correc- 
tions and uncertainties due to MC. These corrections are 
applied to the fits to the charmless data sample. 

To extract the branching fractions for the decay modes 
B^ A'*+7r^ and B^ — > f^K^ we use the relation 



where N^ig is the number of signal events fitted, e is the 
signal efficiency obtained from MC and N^q-^ is the total 
number of B^B^ pairs. 

For the charmless X^tt+tt" branching frac- 

tion (and also for the nonresonant upper limit in the 
_B-background studies above), it is necessary to ac- 
count for the variation in efficiency, between approxi- 
mately 5% and 40%, across the Dalitz plot and to know 
how the signal events are distributed across the Dalitz 
plot. To do this we assign to the jth event Wj = 
J2iVsig,iPi{xj)/J2k^kPk{xj) where Vs^g,^ are the sig- 
nal components of the covariance matrix obtained from 
the fit. This procedure projects out the signal distribu- 
tions ^3 shown in Figures 1-4. The branching fraction 
is then calculated as i3 = J2j'^j/i^j ^ -^bo"bo), where 
Ej is the efficiency, as a function of Dalitz plot position, 
simulated in small bins using high statistics MC. 

Figure shows the signal distributions for B° 
if^TT+TT" candidates and the distributions of events for 
all hypotheses. Figure|21shows the signal distributions for 
both the B° K*+TT- and B° faK° channels. The 
fitted signal yield and measured branching fraction are 
shown in Table |n] for all the modes under study. The 
average efficiency for B'^ — > fCgTr+Tr" signal events is 
16.8% and the continuum background yield is 79000 ± 




AE(GeV) AE(GeV) 



^ ,300 




Fisher Discriminant Fisher Discriminant 



FIG. 1; Plots of the maximum likelihood fit to data for B — + 
K'^n'^-K~ candidates. Plots a)-c) show the distributions of all 
events that pass the selection criteria for (a) mES (b) AE 
and (c) Fisher, with the solid (blue) line indicating the total 
model, the (red) dotted line indicating shape of the continuum 
background model and the (black) dashed line indicating the 
signal model. Plots d)-f) show the signal distributions for (d) 
rriES, (e) AE and (f) Fisher, where the (black) circles are the 
signal distribution UJ^ and the solid (blue) curve is the signal 
PDF that was fitted in the maximum likelihood fit. 



280 events. Figure |2| shows the signal mass projections of 
TO^o^ and m^+^- using B'^ K'^tt^tt^ candidates. The 
TO^o^ distribution clearly shows a peak at 0.9 GeV/c^, 
corresponding to the K*~^{892) mass and there is a broad 
structure above 1 GeV /c^ that is the region where heav- 
ier kaon resonances can occur. The m^+T^- distribution 
shows evidence for resonance structure around 1 GeV/c^ 
that corresponds to the /o and a broader structure be- 
low this that may be attributed as the p°(770). Figure^ 
shows the efficiency corrected signal distribution of the 
cosine of the helicity angle, 9h, for B'^ K*^7r^ . 

Table IIIII shows the systematic uncertainties that are 
assigned to the branching fraction measurements. Con- 
trol channels in data and MC are used to assign uncer- 
tainties due to pion tracking, particle identification, and 
reconstruction efficiency. To calculate uncertainties 
due to the fitting procedure, a large number of MC sam- 
ples are generated from the fitted PDFs, containing the 
amounts of signal and continuum events that are mea- 
sured in data and the number of i?-background events 
that were anticipated for the data set, as explained above. 
The differences between the generated and fitted values 
using these samples are used to ascertain the sizes of 
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2: Maximum likelihood fits for signal distributions. For 
— > if*"'"7r~ the plots show (a) mES, (b) Ai?, and (c) the 
Fisher discriminant. The (black) circles are the signal distri- 
bution extracted from the data with the method of Ref. fv^ 
and the solid curve is the signal PDF that resulted from the 
maximum likelihood fit. For i?" — > foK° , plots show the 
distributions for (d) rriES, (e) AE, and (f) the Fisher discr- 
minant, in an analogous fashion. 



TABLE II: Signal yields and branching fractions for 
K°'K+TT-, B° K'+Tv- and B° ^ foK° where the first un- 
certainty is statistical and where, in the case of the branching 
fraction measurements, the second uncertainty is systematic 
and any third uncertainty is due to possible interference ef- 
fects. The efficiency of selecting B° K'+i^ K'^tt+)tt- 
and — » /o(— > 'k'^'k~)K^ events was found to be 24% and 
27% respectively, whilst the continuum background yields 
were 7300 ± 86 events and 13000 ±110 events respectively. 
The — > K'"^n~ branching fraction takes into account that 
B{K*^ K^tt'^) = 2/3, assuming isospin symmetry. 



Mode 




Signal Events 


Branching Fraction 






Yield 


(x 10-«) 






860 ± 47 


43.0 ± 2.3 ± 2.3 




/o(- 7r^ 


'tv-)K" 120 ± 16 


5.5 ± 0.7 ± 0.6 ±0.3 


B° ^ 


K*+7v- 


140 ± 19 


11.0 ± 1.5 ± 0.5 ±0.4 



any biases. Small biases of the order of a few percent 
are observed that are a consequence of small correlations 
between fit variables and are therefore assigned as sys- 
tematic uncertainties. 

The uncertainty of the B-background contribution to 
the fit is estimated by varying the measured branching 
fractions within their uncertainties. Each background 
is varied by ±lcr and the effect on the fitted sig- 
nal yield is added as a contribution to the uncertainty. 
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FIG. 3: a) shows the mj^o^ signal distribution of B" ^ 

K^tt'^tt' candidates fl^. The one-dimensional distribution 
is obtained by merging and into one (m^^) by 

folding the Dalitz plane along the line corresponding to m^if^^ 
= rn?jf^_ in order to obtain the above ruK-K mass distribution, 
b) shows the m^+^- signal distribution of B^ — > K'^tv^-k" 
candidates p^ . The dashed lines indicate the expected mass 
of the labeled resonances. 
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FIG. 4: Distribution of the efficiency corrected cosine of the 
helicity angle. Oh, for B" — > K'^^-k^ signal events. 



For B''^ —f K*^TT^ there is an additional uncertainty in 
the S-background contributions due to the possible line- 
shapes of the ii'Q^(1430), which can alter the amount of 
B background expected. In order to assign a systematic 
uncertainty, fits to data are performed using two parame- 
terizations, a relativistic Breit-Wigner lineshape and the 
LASS parameterization The latter is a coherent 

sum of a relativistic Breit-Wigner and an effective range 
term, and is used in the analysis of B"^ K^tt^tt^ uM- 
The uncertainty due to simulated PDFs is obtained from 
the channel ^ D^{-^ K2,TT-)n+ and by varying the 
PDFs according to the precision of the parameters ob- 
tained from MC. In order to take correlations between pa- 
rameters into account, the full correlation matrix is used 
when varying parameters. All PDF parameters that are 
originally fixed in the fit are then varied in turn and each 
difference from the nominal fit is combined and taken as a 
systematic uncertainty. The uncertainty in the efficiency 
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is due to limited MC statistics, where over 1,000,000 MC 
events are generated for the decay B° K^'k^tt~ and 
over 150,000 MC events are generated for the decays 



K*+TT- and fiO 
the number of BB 



—^ foK^. The same uncertainty in 
events is used for all channels. 



TABLE III: Summary of contributions to the systematic un- 
certainty in the branching fractions measurements of — > 
K°-K+TT-, B° K*+-K- and B" ^ foK°. The uncertainties 
are shown as a percentage of the measured branching fraction. 



Error 


B" ^ K\+n- 


B" /oi^" 


B" ^ K'+TT- 


source 


Error (%) 


Error (%) 


Error (%) 


Particle ID 


1.9 


1.9 


1.9 


Tracking 


1.6 


1.6 


1.6 


Ks efficiency 


1.4 


1.6 


1.5 


Fit Bias 


1.7 


6.1 


2.6 


PDF params. 


0.1 


0.1 


0.3 


B background 


4.2 


5.9 


2.0 


Efficiency 


0.9 


0.1 


0.1 


No. of BB 


1.1 


1.1 


1.1 


TOTAL 


5.4 


9.1 


4.5 


Interference 




4.7 


4.0 



For the quasi two-body modes, possible interference 
effects between the final state modes were investigated by 
simulating the Dalitz plot using the measured branching 
fractions and random phases. The root-mean-squared of 
the distribution of the branching fraction is taken to be 
the uncertainty. 

We measure the CP-violating charge asymmetry for 



the decay B^ ^ K 



to be Ak' 



-0.11 ± 0.14 ± 



0.05, where the first uncertainty is statistical and the 
second uncertainty is systematic. The charge asymmetry 
in the background is expected to be zero, as is the charge 
asymmetry in signal and background of the self-tagging 
decay B^ _D^7r+. As a cross-check, these are measured 
to be -0.018 ± 0.009, -0.013 ± 0.029 and 0.005 ± 0.031 
respectively, where the uncertainties are statistical only. 

The systematic uncertainty on Ak'tt is calculated by 
considering contributions due to track finding, particle 
identification, fit biases and -B-background asymmetry 
uncertainties. Biases due to track finding and particle 
identification were found to be negligible. The fit-bias 
contribution to the systematic uncertainty is calculated 
using a large number of MC samples. The contribution 
from B background is calculated by varying the number 
of expected events within their uncertainties yjl] and by 
assuming a conservative CP- violating asymmetry of ±0.5 
as there are no available measurements for these decays. 
The resulting systematic uncertainty on the asymmetry 
is measured to be ±0.05. 

In summary, the branching fractions for B^ —>■ 



K°n+Tr-, B° K*+Tr- , and 5° 



/o(- 



decaying to a K^n^n^ state are measured and all agree 
with previous measurements 0, S S @ ■ measure the 
direct CP- violating parameter Ak'tv for the decay P° 



K*~^TT , with no evidence of CP violation with the statis- 
tics used. These results supersede the previous results of 
the BABAR Collaboration jl|3|. 
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